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Introduction 

The Agricultural Model Intercomparison and Improvement Project (AgMIP) has 
the goal of using multiple crop models to evaluate climate impacts on agricultural 
production and food security in developed and developing countries. There are 
several major limitations that must be overcome to achieve this goal, including the 
need to train AgMIP regional research team (RRT) crop modelers to use models 
other than the ones they are currently familiar with, plus the need to harmonize 
and interconvert the disparate input file formats used for the various models. Two 
activities were followed to address these shortcomings among AgMIP RRTs to 
enable them to use multiple models to evaluate climate impacts on crop production 
and food security. We designed and conducted courses in which participants trained 
on two different sets of crop models, with emphasis on the model of least experience. 
In a second activity, the AgMIP IT group created templates for inputting data on soils, 
management, weather, and crops into AgMIP harmonized databases, and developed 
translation tools for converting the harmonized data into files that are ready for 
multiple crop model (hereafter termed multi-model) simulations. The strategies for 
creating and conducting the multi-model course and developing entry and translation 
tools are reviewed in this chapter. 
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Participants came to the multi-model training course with data that they had 
already tested and simulated with their favored model; an iterative process com • 
monly referred to as model “calibration”. Following lectures on the general princi- “ ^ 
pies of crop growth and soil-water balance common to bolh models, ihe participants 3 
used the IT tools to convert the files into the alternate model, and worked with the 
experts of those models to step through a calibration process with the new model ' 
This provided each crop modeling team with a second simulation of production ? 
associated with the same fanner field survey data. , ; 

The course was clearly valued by the participants, as it was a mid-project achieve- I' 
ment that allowed them to complete the multi-model simulations as part of the inte- *'■ 
grated assessment that they were doing in their regional research teams (see Part 2 
Chapters 1-12 in this volume). The designation and use of trainers and AgMlP S' 
resource persons was very valuable, as they mentored and assisted small working ?i 
groups, the number of which exceeded the number of instructors available Further ’ 
more, the course was a good test-bed for the IT tools, providing evaluation that led > 
to improvements in the conversion tools for creating model-ready files. 

History of Crop Modeling Courses 

■s 

Training in crop modeling has followed several pathways. A common pathway over I 
the past 30-40 years has been one-on-one training during graduate or post-doctoral 
programs, or during targeted visits witii crop modeling experts. A second pathway 3 
has been structured training courses in which a number of trainees come to alocation S 
and follow a five to eight day course of lectures, hands-on training, and exercises. );! 
The first of these types of one-week training courses was conducted in 1981 by the ^ 
Department of Theoretical Production Ecology, Wageningen Agricultural Univer- ’ > 
sity, the Netherlands. The senior author was privileged to attend that course That ’ 7 

course was connected to the 1982 book edited by Penning de Vries and van Laar 5 
(1982). 

University of Florida crop modelers (J. W. Jones, K. J. Boote, and G. Wilt j 
erson) conducted their first crop modeling course at the University of Florida in ' 
1985, with a similar one-week format. After that initial start, a larger group of crop - 
modeiers associated with the International Benchmark Sites Network for Agrotech- ; ■ ? 
nology Transfer (IBSNAT) project proceeded to conduct six to ten day crop modeling 
courses at various sites in the US and around the world, beginning with Taiwan in ^ 
1986 and the International Center for Research in the Semi- Arid Tropics (ICRISAT) 
in 1987. Crop modeling courses with the Decision Support System for Agrotech- 
nology Transfer (DSSAT) software have continued since on a nearly annual or 
biannual basis (Hoogenboom et al„ 2010; Jones et al, 2003). The course was 
offered 20 times in the USA since 1985, and international courses were taught 
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Table 1. History and locations of DSSAT training courses since 1985. 


Country 
United States 

Taiwan 

India 

Senegal 

Venezuela 

Republic of South Africa 

Hungary 

Canada 

Egypt 

Togo 

Thailand 

Tanzania 

Ghana 

Argentina 

People's Republic of China 

Kenya 

Namibia 

Malaysia 

Spain 

Barbados 


Year of training course 

1985, 1991, 1992, 1993, 1994, 1995, 1996, 1997, 1998, 

1999, 2002, 2004, 2006, 2008, 20Q9, 2010, 2011, 2012, 2013, 2014 

1986 

1987,2010, 2011,2012 
1989, 2014 
1989 

1990, 1995 
1991, 1992 

1997 

1998, 1999. 

1998 ; 

2003, 2004, 2007, 2013, 2014 

2004 

2005 

2006, 2007 

2006 
2007 
2007 
2009 
2009 
2012 


in Taiwan, India, Senegal, Venezuela, Republic of South Africa, Hungary, Canada, 
Togo Ghana, Egypt, Tanzania, Argentina, the People’s Republic of China, Kenya, 
Namibia, Malaysia, Barbados, Spain, and Thailand (Table 1). The number of par- 
ticipants ranged from 10-60 people, usually 20-30 at a time. The book edited by 
Tsuji Hoogenboom, and Thornton (1998) serves as the textbook for the DSSAT 
crop modeling courses. More than 1000 students have been trained over this period. 

The Dutch crop modelers conducted similar training courses on a regular basis, 
especially during the Dutch government-funded project. Simulation and Systems 
Analysis for Rice Production (SARP) in Asia during the mid-1980s to the mid- 
1990s (ten Berge, 1993). In that project, the Center for Agrobiological Research 
and Wageningen Agricultural University linked with the International Rice Research 
Institute and 16 national agricultural research centers in Asia, to conduct systems 
analysis and simulation modeling, mostly on rice, by using Ihe SUCROS model 
(Penning de Vries et al, 1989). Training courses were conducted at Wagemngen 
and at international sites, following the template of the Penning de Vries and van 
Laar (1982) book, along with training in use of SUCROS and use of the Continuous 
Systems Modeling Program (CSMP) language. 


396 


K. J. Boote et al 


Other models and modeling groups such as the Agricultural Production Systems" ' 1 
Simulator (APSIM; Keating et al, 2003), EPIC (Izaurralde et al, 2006; Williams V 
et al., 1989), and CropSyst (Stockle et al, 2003) hold somewhat shorter in-house 
training sessions for one to ten people at a time, generally at their research sites 
The CropSyst group uses web-based training approaches. APSIM conducts two-dav l ’ 
training sessions several times per year in Australia, mostly on operational aspects s' : 
of the model software. Many Australian international agricultural research projects £ 
include five-day APSIM workshops in-country for 15-20 persons as required. These T’ 
courses are tailored for the regions (i.e., Africa and Asia) in which the project mem- £ 
bers operate, and usually consist of three days of hands-on activities with science 
theory and understanding of the dynamics of the processes producing the simulation £-■ 
results, followed by two days of small-group activities using simulations to explore 5? 
local issues and strengthen simulation skills. A half-day of instruction on soil sam- $ 
plingis sometimes conducted. Other APSIM international training activities include 
participatory crop modeling training that targets agricultural researchers proficient S 
in the use of APSIM for adding value to on-farm research and extension focusing on f J 

climatechangeadaptationandcropproduction.ThefirstintemationalAPSIMcourse Jr 

was held in 1 997 at the ICRIS AT center as part of a joint project entitled “Collabo- ■£. 
ration on Agricultural Resource Modeling and Applications in S emi - Arid Tropics'’. V: 

Approaches Followed in Crop Modeling Courses : ■ -Vx 

The approaches in the DSSAT and Dutch-SARP crop model training courses fbl- ^ 
lowed a template that included some lectures interspersed with hands-on use of the 
software and model interfaces, along with exercises. The lectures covered princi- 
ples of crop phenology, crop carbon (dry matter) balance, crop soil-water balance, 
soil-plant N balance, model calibration, model sensitivity analyses, etc. The hands- 
on training with the software included exercises to demonstrate data entry, proper 
creation of weather, soils, and management files, model calibration, model simu- 
lation, and data analyses. Trainees were encouraged to come with their own data 
and to develop a special topic or exercise with their data. If they did not have data, 
students were given topics in which they were to create model-ready files to con- 
duct multi-year simulations of various treatments or crop sequences. Results were 
then analyzed to evaluate how various treatments affected crop yields, irrigation 
requirements, seasonal evapotranspiration, soil C dynamics, fertilizer N response. 

N leaching, economic returns, and optimal economic decisions, etc. 

The Dutch government-funded SARP project, particularly’ in its later phases, 
discovered that sustained follow-through was very important. Project organizers 
established and funded a program for field-oriented scientists from Asia for one- 
year of formal training that involved about half-time on field data collection and 
half-time on crop modeling (ten Berge, 1993). The African Network for Soil Biolog* 
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and Fertility (AfNet) Project (Bationo et al., 2012) established a similar program 
in Africa. In this multi-year-funded project, African scientists participated in an 
introductory crop modeling workshop, followed by field data collection on a topic 
that could be further analyzed by crop model simulations, followed by a workshop 
with die models and their data, and then a third workshop to present their final results 
that ended up as written papers being published in a book (Bationo et al., 2012). 
A similar approach is followed by Australian projects that make use of the APSIM 
systems modeling as an analysis tool. 

APSIM workshops are conducted in Australian projects in which simulation is 
required as an analysis tool for components of the project (Keating etal . , 2003). Most 
experiences are published in project reports by the projecfcsponsors (e.g., Australian 
Center for Interna tional Agricultural Research, Australian Agency for International 
Development, ICRISAT, and Rockefeller Foundation). 

Reasons for Multi-model Course Taught by AgMIP Scientists 

The AgMIP project has a strong focus on multi-model simulations to evaluate 
impacts of climate scenarios on agricultural production, similar to the use of mul- 
tiple global climate models for prediction of future climate (Rosenzweig et al., 
2013). The concept of multi-model use is that the ensemble of several models may 
be a better predictor than any given single model, as already learned by the AgMIP 
wheat teams (Asseng et al., 2013), the AgMIP maize teams (Bassu et al., 2014), 
the AgMIP rice teams, and AgMIP sugarcane modelers. As a result, projects using 
AgMIP protocols require the application of at least two crop models. This goal can 
be achieved by bringing together scientists with expertise in different models to 
analyze datasets from the region of interest. However, in many regions, especially 
in developing countries, there are few scientists proficient in crop modeling and 
RRTs may have scientists proficient with just one model. Thus, there is a need to 
encourage these crop modelers to learn to use more than one crop model, as well as 
to collaborate with others in multi-model activities. 

Specifically, participating scientists in the regional teams funded by the UK 
Department of Foreign International Development (DFID) wished to use multi- 
ple crop models (DSSAT and APSIM at minimum) to simulate yields relative to 
farm survey d ata collected by socio-economists as a way to evaluate climate impact 
on farm-to-farm variability in production, and subsequently to conduct integrated 
production-economic assessment. Therefore, AgMIP leaders developed training 
courses for the regional team participants in which multi-model training/use were 
emphasized. In the AgMIP Handbook protocol (see Part 1, Appendix 1 in this vol- 
ume and Rosenzweig et al., 2014) of the DFID-funded regional integrated assess- 
ment projects, economists use the simulated farm-to-farm variability and simulated 
climate change ratio (R, the yield under 30-year future climate divided by yield 
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under 30-year current climate for each farm). The value of R is multiplied by the" 
present farm survey yield as part of an integrated assessment of winners and losers 
among the farmers as affected by climate change and technological adaptation. The 
value of R for a given field may differ among crop models, thus representing a range 
of uncertainly regarding the potential effect of climate change on crop production. 

Other reasons for multi-model courses are that participants want to learn about 
crop models other than the model they currently use. Participants are interested in 
seeing how other models take different approaches to address soil processes, crop ; ; 
management, and cultivars. The crop modelers can translate their experiences from ’ 
one model to the next, because the concepts are often similar even if the coefficients '■ 
and model structure may be different. Although the crop models and the software 
interfaces may differ among different modeling groups, the basic principles are sirm- i 
lar relative to use of weather, soils, and management data. Likewise, crop growth and 
yield measurements are similar in use andpurpose, despite different variable nanung ? 
and different graphical and text comparisons of simulated versus observed values ■' 

Finally, modelers understand that all models need further calibration and devel- ^ 
opment to improve their simulation of biophysical field conditions. Learning about ' 
how different models simulate response to the biophysical environment provides 
rich stimulus for considering how to further improve model processes themselves '* 
Differently parameterized models typically yield different results for the same input ^ 
data deciphering why this happens is an important learning experience for mod- 

elers, who must be able to assess and interpret outputs — all of which yield infor- ' . 
nation (or limitations) as to how models simulate agricultural systems, and why $ 
they sometimes “fail”. 4 

An important reason for the AgMIP multi-model course was to introduce and 1; 
teach the crop modelers how to use the newly developed IT tools (see also Part 1. '3 
Chapter 6 in this volume) for data entry and conversion. The alternative would have 
been for students to learn both the DSS AT- orAPSIM-specific tools for defining crop % 
management in the models based on the farm survey data, but this would not have -1 
accomplished the objective of having the same data entered once with templates 4 
into the AgMIP-harmonized format and being translatable into the files ready to run 
for both models. For that reason, the IT tools were a strong focus for at least three 
days of the training course. AgMIP is motivated to help create tools that encourage 
tiie use of multi-model approaches by easing the ability to move among models, an 
activity that requires close collaboration with the model developers themselves (see 
also Part 1, Chapter 6 in this volume). 


Planning and Preparations for the Multi-model Training Course 

Potential participants were surveyed to learn of their prior experience in crop mod- 
eling with their currently used model and to designate which model they wanted to 


I 


AgMIP Training in Multiple Crop Models and Tools 


399 



learn more about. An important requirement was that participants have prior experi- 
ence with at least one crop model, as this course was not designed to be a beginners’ 


course. 

Prior to the tr aining course, an email was sent to participants requesting that 
they: (1) come with their own portable laptop computer, (2) identify and come 
with sentinel site experimental data following AgMIP sentinel site data standards 
(Kersebaum et al ,2014) that had a minimum amount and quality of measurements of 
crop life-cycle phenology, final biomass, final yields, modest growth analyses, along 
with site-specific wealher, soils and crop management inputs in order to simulate 
crop growth, for which they were already running their current model and for which 
they would calibrate cultivar coefficients with a new model; (3) come with the farm 
survey yield data (as well as associated management and soils data), which they 
would enter during file course; and (4) come with 30 years of historical baseline 
weather data for the farm survey region, including weather for the actual farm survey 


years. 

The 30-year current baseline weather data were to be modified by their climate 
scientist colleagues to produce a given defined climate scenario by using the delta 
method. During the course they followed-up with crop simulations of the indi- 
vidual farm sites in order to calculate the climate change ratios to provide to their 
economist collaborators, by following protocols of the AgMIP Handbook (see Part 1, 
Appendix 1 in this volume and Rosenzweig et al., 2014). 


i 


Instructors and Train-the-Trainers 

| 

An important goal of AgMIP is capacity-building and development of regional crop 
modeling capability, to include facilitating individuals with the potential to become 
future instructors and trainers of other crop modelers. Prior to the multi-model 
training course, the instructors (K. J. Boote, C. H. Porter, J. Hargreaves, and G. 
Hoogenboom) and P. Thorbum engaged AgMIP coordination in a process of candi- 
date selection, with selectees demonstrating good crop modeling skills, good lead- 
ership, and good teaching and mentoring potential, with appropriate regional and 
gender representation (five developing countries and two women). The selectees 
included D. S. MacCarthy (Ghana), D. M. Kadiyala (India), D. Fatondji (Niger), 

N. Subash (India), G. Baigorria (US), P. Masikati (Zimbabwi), B. Singh (India), 
and A. Wajid (Pakistan). During the training course, these individuals took an active 
role to Tnftn tn r and assist their colleagues on particular models and/or crop exper- 
tise that they had. The instructors provided additional guidance and advice to these 
designated individuals, with the expectation that they would return to their region 
or university and help train other crop modelers in their current team, university, or 
region. 
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Conducting the Course and the Course Syllabus ' f f 

The! course was conducted at two locations using the same curricula and overall h 
p an: During March 18-22, 2013 at Hotel Annapurna, Kathmandu, Nepal (aboutten ’ 
students attended), and during March 25-29, 2013 at the ICRISAT center, Andhra 

rtf AxS ab . 0< ? 40 StUdentS attended ’ see Part 2 > A PP e ndix 1 in this volume for 

e SAT Workshop report). To the extent possible, trainers-in-training attended 

botii events. This allowed for close interaction and advancement of their own capa- 
bwtiesm the first, smaller event - and provided immediate opportunity to utilize 
their skills as trainers in the second, larger event. The photo (Fig. 1) shows the initi- 
a on of the second course, held at the Learning Systems Unit at ICRISAT. Course 
activities for the AgMIP Multiple Crop Model Training Program are described in 
the syUabus (Annex 1 at the end of this chapter). In addition, participants were 
provided with the Guide for Regional Integrated Assessments: Handbook of Meth- 
ods and Procedures, Version 4.0, specifically Appendix 2, Crop Model Simulations 
for Integrated Assessments: User’s Guide, available in the AgMIP Handbook (see 
Part 1 Appendix 1 in this volume and Rosenzweig et al, 2014). The latter con- 
tarn die AgMIP protocols for using die IT tools for entering farm survey yield 
data in template files, creating the data overlay files to provide assumptions for 
mformation missing from survey management and soils, and conducting the crop 
mo snnulations to produce results to pass on to the economists for the integrated 

biophysical and socio-economic assessment. 
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During the first day of the course, we introduced the integrated assessment 
goals, and then gave an overview of DSSAT and APSIM crop models, specifi- 
cally how phenological development, growth and yield, soil-water dynamics, and 
genetic coefficients are formulated in each model. Principles of genetic coefficient 
calibration were introduced. Initially, all participants were together in the same 
room learning about both models. Late in the afternoon of the first day, participants 
installed their newly chosen models, and learned the procedures for inputting new 
crop, soil, management, and weather data for the purpose of estimating genetic 
coefficients from the sentinel site experiment data. 

On day 2 of the course, after one plenary lecture on soils and crop management 
aspects, we separated into two parallel sessions, with one^ group learning DSSAT 
and the other learning APSIM. During the rest of this day, students worked with 
their new crop model, and entered soil, weather, management, and crop observa- 
tion data, which they used to estimate the model-specific genetic coefficients for 
their cultivar from their sentinel site experiment data. As necessary, small-group 
model-specific lectures were conducted to address model-specific issues related to 
genetic coefficient calibration. 

On day 3, the students completed their calibration of genetic coefficients for their 
new crop model, created visuals, and presented their results per team in a plenary 
session near mid-day. After each presentation, we discussed what had been done 
and gave recommendations for improvement. 

In the afternoon of day 3, the AgMIP IT tools — survey data template, data 
overlay files, and QuadUI (the desktop application for data translation) — for enter- 
ing farm survey data were introduced and explained (see also Part 1, Chapter 6 
in this volume). The participants then began to enter their farm survey yield and 
management information into the AgMIP template spreadsheets. 

On day 4, there was aplenary lecture on the goals of AgMIP integrated assessment 
for analyzing farm production as well as methods for analyzing farm survey data and 
gjT pniafp.H production. We discussed proper use of AgMIP tools to complete entry 
of field survey data as well as creation of Data Overlay for Multi-model Export 
(DOME) files for input of missing initialization and management information. We 
assisted the participants in use of the AgMIP tools to convert field survey data into 
model-ready files. We advised on the need to verify their inputs (management, soils, 
initial conditions, and cultivar) and assisted in getting the crop models to run with 
their data. 

We assisted in analyzing simulated results and in computing the mean and plot- 
ting the cumulative probability of exceedance for the observed farm survey yields 
and model-simulated yields on the same graph. Figure 2 illustrates the probability 
of exceedance of a given yield level for farmer survey yields, compared with the 
yields simulated by DSSAT and APSIM for peanut fields near Nioro, Senegal in 
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Fig. 2. Probability of exceedance of a given yield level among fanner survey fields, DSSAT simu 
lations, and APSIM simulations for peanut fields near Nioro, Senegal in 2007 (courtesy ofCIWARA 
team in Part 2, Chapter 2 in this volume). 


2007 (courtesy of AgMIP’s Western Africa team, CIWARA; see also Part 2, Chap- ! 
ter 2 in this volume). The farmer survey fields generally have greater yield variation, * 
possibly because failures from pest, disease, and weed problems in fanner fields ' 
mean that the models do not simulate, as well as insufficient variation of soils ' 
(water/productivity) assigned to the model simulations. We discussed the need to ? 
evaluate the simulated and observed distributions and to understand the causes for ' 
model failure to predict accurately the mean as well as the high or low tails of the ! 
cumulative probability of exceedance. In some cases, these were caused by sim ple i 
enors in setting up of the models and these were resolved. In some cases, soil initial- • 
condition assumptions related to soil water and soil organic carbon pools had major 
effects on the distributions obtained. # 

Although the economists had requested that no external bias adjustments be made \ 
(because they only needed the value of climate change ratio (R) to be predicted to | 
transform the observed yield in each farm), there were often serious bias-influencing J 
input issues relative to initial soil water, initial soil mineral N, soil organic C pools, *1 
and residue assumptions that were made (because such information was missing ■; 
from the farm survey data). Consistent rules for bias-adjusting corrections were ' 
suggested to facilitate realistic yield levels and distributions for the region that 
would be believed by stakeholders. At the same time students were cautioned that 
corrections needed to be limited to broad classes of problems for multiple farms, ; 
and in no case were adjustments allowed to be made on a “farm-by-faim” basis 'i 
in absence of data. The reason for this caution was that at least one group had *■ 
previously micro-calibrated inputs for every single field (without true evidence of t 
input variation) to exactly mimic the observed yield for each and every survey field 
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On day 5, there was a plenary lecture on seasonal analyses with multiple weather 
years that was presented as a way to analyze the risk of weather variability. Then the 
student-modelers moved on to conduct multi-year simulations using the seasonal 
strategy tools that provide consistent rules of auto-sowing to be set up, since the 
“single year” farmer survey sowing dates were potentially inappropriate for future 
climate conditions. Multi-year simulations were run for both baseline “current” 
weather and at least one future climate change scenario. Participants were shown how 
to use the IT tools to place the simulated yields (current and future) into the AgMIP 
crop model output (ACMO) harmonized format, ready for use by tihe agricultural 
economists (see also Part 1, Chapter 6 in this volume). Mean 30-year yield per farm 
was computed for the baseline and for future climate, for pse in computing the value 
of R for each farm. The students prepared presentations of their results that were 
reported in a joint session that facilitated discussion and recommendations. The 
course ended with participant feedback of what worked and what did not work. 

Experiences during the Course: What Worked and What Did Not 

Some of the participants were not as experienced with crop modeling as presumed 
when setting up these workshops. All participants should have had a full basic train- 
ing course prior to coming to this multi-model course. Because of time limitations 

and the need to use twocrop models along withnewTT Tools, this multi-model course 

intentionally did not include the basic lectures or hands-on training exercises typical 
of beginners’ crop modeling courses. That created some frustration and lack of effec- 
tive learning for some participants who came with insufficient required experience. 

The number of participants also made a difference. There were ten students in 
Nepal and 40 at ICRISAT, and the latter number stretched the training capacity of 
the four instructors despite help from the eight designated “train-the-trainers in 
the role of instructor-advisors. There was a relative deficiency in APSIM instructor 
support, allhough five of the trainers had some APSIM experience. Train-the-trainers 
provided expertise to solve many issues along the way, considering that there were 
only four primary lecturers and that many IT tool issues came up along with the 
typical crop model issues. The train-the-trainers also provided expertise on alternate 
crops. Because of several different crops and different country teams (six teams at 
ICRISAT), students evolved into many small working groups, which is another 
reason that multiple instructors and trainers with expertise in different models and 
crops were needed. 

The installation and setup of the DSSAT and APSIM models worked well on the 
individual students’ laptop computers, with a few exceptions due to international 
language operating systems and Macintosh computers. There were some difficulties 
with the use of the new IT tools. The rice models required additional management 
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inputs to charactenze paddy management (puddling, bund height, flooding deotf, ' 

® A °“ rate ’ etc -^ which had not y et been programmed into the data translators' 
or SAT or APSIM. By the time of the second one-week course held at ICRISAT 

these problems were mostly solved. 

Mid-week, we had separate break-out sessions of 20-30 minutes in which " 
mstractors met separately with each modeling team, to look in detail at the model 
input files for simulations, to verify correct entry and use of sentinel site data for cal- i 
i rating cultivar coefficients, and to set up model assumptions for farm survey fields 
r i °i tial Soil water ’ initial nitrate and ammonium, and soil organic 

WerC l ° be USec ^‘ 111 sessions, the DSSAT modelers worked 

J? “ CtOTS 311(1 modelers worked with the APSIM instructor ^ 
This double-check was very important and valuable to all, despite not being listed * 
as a course topic. While inspecting the model input files, we discovered many issues ^ 

J* " “T 1 " 8 fOT «" crop residue, nitrate andan^ 5 

mum, ^d failure to simulate nee as paddy. Some teams “micro-calibrated” to each & 

d an< ^ J h 1S WaS strongIy discouraged. Some did the dimate scenarios incor- " 
eefly. These were issues that were not apparent in the preliminary written reports J 

slulaST'H a * reqUired 1116 re ‘ doin S re-running of their original t 
unuIatrons^Kands-ou-evaiuatiori of model input files by model experts must L a S 

part of all training courses that have viable simulations as an output ^ 

d J!!! ^ SUCCeSSfuI ^ used for tem P late enti y» and conversion of survey 1 

data to DSSAT ready-to-run files worked for maize, millet, and wheat. Conver- > 

sion to files ready to run for the DSSAT CSM-CERES-rice did not work initially V 

raTeTuVd he^r° n H water management (puddling, percolation 

rate, bund height, and water height). These were solved during the multi-model t 

teaming courses. The tools to convert to APSIM-ready files worked only for maize % 

beiDg f “ beta ” “ Whlch t0 ide ntify issues teat | 

foe AgMIP TT team needed to resolve for wheat, sorghum, and millet model files; i 

solvedTater reS ° lved by ^ end of ^ ^ weeks. The APSIM-rice issues were 'C 

-ty 

A shortcoming of this course was fliat no one successfully parameterized lie ~ 
soil carbon modules, whether the DSSAT CSM-CENTURY's stable soil carbon *t. 
poo (SOM3) or the APSIM’s fraction inert soil carbon pool. He CENTURY soil 
carbon option was generally not used despite encouragement to use it, and it was 
never used for die rice models. So, a conclusion hem is that the correct setting of 
soil carbon pools is a major difficulty in the mop models, and that this may limit 
foe«ny to accurately predict production of non-legmnes under degraded soil 

of ‘ hae WaS a™ «> discam the effects 

of climate change scenarios, and specifically the climate change ratio. He five-day 

course was too short. We also lacked time for sufficient discussion and evaluation of 
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the probability of exceedance distributions (and means) for simulated and observed 
farm survey yields, despite having a final report-back on those topics on the last day. 
The report-back on genetic coefficient calibration early in the week worked well. 

Feedback at end-of-day and at start of every morning was valuable for purposes 
of discovering how far individual groups had progressed and to solve any prob- 
lems that may have arisen. The majority of the project-funded teams managed to 
calibrate genetic coefficients for both crop models, and accomplished their farm 
survey rimniatiniis for at least DSSAT. Deficiencies in the APSIM data translator 
prevented completion of APSIM simulations for rice, wheat, and millet crops. The 
tf mms learned enough that they could return to their countries and complete the 
simulations later, after file data translation issues were solved. 


Conclusions and Next Steps 

The AgMIP Multiple Model Course was clearly needed and valued by the crop mod- 
eling participants, as it allowed them to complete the multi-model simulations for 
the integrated assessment that they were doing in their RRTs. The course generally 
went smoothly, especially in Nepal, where the number of students was small (about 
ten) and the crops fewer. At the ICRISAT center in India, the facilities were good, 
but the auditorium setting and the number of students (40 or more) with diverse 
regions and more crops simulated, made the course more difficult to handle. More 
of the participants at ICRISAT were beginners to crop modeling. Future courses with 
multi-model agendas will need to ensure better beginners’ training or vetting of the 
participants. The use of trainers and AgMIP resource persons was very valuable, 
as they assisted with the many small working groups that exceeded the number of 
instructors available. 

The IT tools generally worked as planned, although mid-course improvements 
in file conversion tools were needed in order to create model-ready files for DSSAT 
CSM-CERES-rice, and for nearly all APSIM crops with the exception of maize. In 
that sense, the course provided a useful opportunity to test, refine, and improve the 
IT tools. 

The need for continued training in crop modeling is highlighted by this course. 
Distance-training modules can be designed, but will require coordination with 
DSSAT and APSIM modeler groups who have the training materials. The use of 
the IT tools for multi-model use and translation of data formats from one model 
to the other could be set up as a distance-training module within AgMIP. Another 
approach is to encourage the new train-the-trainers to lead crop model training 
courses in their own regions and institutions. 

The participants in the multi-model training were requested to identify spe- 
cific actions planned after tins course to include: (1) How will the multiple-model 
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AgMSP Multiple Crop Model Gaining Program 
25-29 March 2013 
ICRISAT 

Andhra Pradesh, India 
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Program 


Day/Date/ 

Time 

Day 1 
Monday 
25 March 
0800-0830 
0830-0900 


0900-0940 


0940-1000 

1000-1100 

1100-1200 

1200-1300 

1300-1400 


Session 

Plenary Session — Welcome 
Introductions — each participant 
About AgMIP Project 
Course objectives, overview of program 

Group Photo, Tea/Coffee break 
Overview of DSSAT growth and phenology 
° V n e ™ ew of APS1M growth and phenology 

Principles of genetic coefficient calibration 


Facilitate! 


G Dileepkumai 
AH 

Peter Crauftud 
Ken Boote 


Ken Boote 
John Hargreaves 

Ken Boote 
(Continued) 
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G Dileepkumar 
All 

Peter Craufiud 
Ken Boote 


Ken Boote 
John Hargreaves 


Ken Boote 


(Continued) 


Day/Date/ 

Time 

1400-1430 

1430-1445 

1445-1700 


1700-1730 

1830 

2030-2130 


Day 2 
lUesday 
26 March 

0830-0930 

0930-1200 


1200-1300 

1300-1700 


1700-1730 

1930-2100 

Day 3 
Wednesday 
27 March 

0830-1200 


1200-1300 

1300-1400 

1400-1445 

1445-1500 

1500-1530 


Session 


Facilitator 


Discussion — Issues with data and calibration 
Tea/Coffee Break 

Parallel Sessions: DSSAT and APSIM Groups 
Model installation and operation 
Example calibration of genetic coefficients 

Procedures for inputting new crop, soil, management, weather data. 
Entering new experiments for use in estimating GCs 
Plenary Session: Discussion of progress, issues 
Welcome Dinner 

Optional Session for review and refinement of data, prior calibrations, 
methods 


Instructors 


Instructors 


Overview: Consideration of soils and management; parallel DSSAT and 
APSIM sessions; exploration of soil, weather, management, and crop data; 
understanding model-specific genetic coefficients; feedback on progress 
and issues; optional evening session for review and practice. 

Plenary Session: Initializing soils and management for reliable Cheryl Porter 

simulations 

Parallel Sessions: DSSAT and APSIM Groups 

Work with participant’s data (use AgMIP IT tools as available to convert 

files); review their prior simulations. 

Soil 

Weather 

Management 

Crop observations 

Verifying inputs and simulations 

Lunch 

Continue Parallel Sessions: DSSAT and APSIM Groups 

Model-specific genetic coefficient lectures 
Calibrate model for genetic coefficients 
Plenary Session: Discussion of progress and issues 
Optional Session for review, work, and practice 


Overview: Continue parallel sessions, undertaking genetic coefficient 
calibrations; present findings in plenary; utilize AgMIP tools and 
procedures for integrated assessment; initiate field survey data analysis; 
optional evening session for review, work and practice. 

Parallel Sessions: DSSAT and APSIM Groups 
Participants complete estimation of genetic coefficients 
Prepare summary graphs, report 
Lunch 

Plenary Session: 

Presentation of genetic coefficient calibrations (5 minutes each) 

Discussion of calibrations, feedback, recommendations to teams for 

follow-up 

Tea/Coffee Break 

Plenary Session: 

Goals of AgMIP integrated assessment (creating economic inputs & results 
for DSS) 


Instructors 


Ken Boote 


( Continued ) 


(Continued) 
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(Continued) 


Facilitate* 
Cheryl Porter 


Day/Date/ 

^ me Session 

AgMIP tools and procedures for integrated assessment 
Use AgMIP Tools to complete entry of field survey data 
Create Overlay for “missing” imtialization/management 
Convert field survey data into model-ready forms 
Indi vidual Study in Plenary: Participants working on their field survey 

Discussion 

Optional Session for review, work, and practice 

Thn^do ° bie m AsMIP integrated “Aments; analyzing farm production; 

M US ‘? ^ to0lS 10 handle data ; verify inputs" and simulate 

28 Mam* productivrty; analyze, bias correct, interpret, question 
reliability/believability of findings. 


1630-1700 

1700-1730 

1930-2100 


0830-0900 Plenary Session: 

0900-0915 “iof analyZi " S fa ™ SUfVey ° bSerVed “ d SimUlated Producti0n 

0915-0930 Tea/Coffee Break 

0930-1200 Parallel Sessions: DSSAT and APSBVf Groups 

Verify inputs (management, soils, IC, cultivar) & simni ate 
Analyze simulated results, mean, cumulative probability 
Compute bias and determine if adjustments are needed 
Are results reliable? Believable? 

1200-1300 Lunch 

1300-1700 Parallel Sessions: DSSAT and APSIM Groups 

Verify inputs (management, soils, IC, cultivar) & simulate 
Analyze simulated results, mean, cumulative probability 
Compute bias and determine if adjustments are needed 
Are results reliable? Believable? 

1 700- 1 800 Plenary Session: 

Discussion of problems and issues 


DayS 
Friday 
29 March 
0830-0900 

0900-1030 

1030-1045 

1045-1200 

1200-1300 

1300-1500 

1500-1600 


1600-1630 

1630 


J VCS * oea s°nai analyses; multi year simulations, ACMO files 
collaborative preparation of reports (for presentation by selected traine 
presentation; feedback on training. 

Plenary Session: 

Seasonal analyses with multiple weather years 
Parallel Sessions: DSSAT and APSIM Groups 
Conduct multi-year simulations for integrated assessment 
Tfea/Coffee Break 

Participants create ACMO files from survey year and Multi-year 
simulations (ready for economists) 

Lunch 

Participants collaborate to prepare summary graphs and short report for 
presentation by selected trainees 
Plenary Session; 

Participants present reports (10 min each) 

Haulers will critique and discuss results 

&rfTk^ig eedbaCk: What W ° rked ’ ^ ‘ S n6eded ’ f ° Uow up actions 


G. Hoogenboom 


C. Porter 
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